BOUNDS ON TRIANGULAR DISCRIMINATION, HARMONIC MEAN AND 
SYMMETRIC CHI-SQUARE DIVERGENCES 



INDER JEET TANEJA 



Abstract. There are many information and divergence measures exist in the literature on in- 
formation theory and statistics. The most famous among them are Kullback-Leiber ,15 relative 
information and Jeffreys |14| J-divergence. The measures like Bhattacharya distance, Hellinger 
discrimination, Chi-square divergence, triangular discrimination and harmonic mean divergence 
are also famous in the literature on statistics. In this paper we have obtained bounds on triangu- 
lar discrimination and symmetric chi-square divergence in terms of relative information of type 
s using Csiszar's f-divergence. A relationship among triangular discrimination and harmonic 
mean divergence is also given. 



1. Introduction 



Let 



(pi,P2,-,Pn) 



Pi > 0,^Pi = 1 \ , n ^ 2, 



i=i ) 

be the set of all complete finite discrete probability distributions. For all P,Q £ T n , the following 
measures are well known in the literature on information theory and statistics: 

• Bhattacharya Distance (Bhattacharya [2]) 

n 

(i.i) B{p\\Q) = Y,Vmi- 

• Hellinger discrimination (Hellinger |13| ) 

1 - 

(1-2) KP\\Q) = 1 - B(P\\Q) = ±J2(VPi- v^) 2 - 

i=i 

• x 2 ~ Divergence (Pearson |18j ) 

(i.3) x 2 (piiq) = E^^ = E^-i. 

i=l Qi i=l qi 



Relative Information (Kullback and Leibler J^] 



(1.4) k(p\\q)=Y j pM-)- 

i=i qi 
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The above four measures can be obtained as particular or limiting case of the relative infor- 
mation of type s. This measure is given by 



Relative Information of Type s 

K S (P\\Q) = [s(s - I)]' 1 



(1.5) 



**(P\\Q) 



1-s 



.1=1 



K{Q\\P) = E^ln 



i=l 



K{P\\Q) = Y,Pil* 



8=1 



/J, 



a ^0,1 
s = 
s = 1 



The measure (|1.5j) admits the following interesting particular cases: 

(i) $_ 1 (P||Q) = i X 2 (Q||P). 

(ii) $ (P||Q)=^(Q||P). 

(iii) <& 1/2 (P||Q) = 4 [1 - P(P||Q)] = 4h(P\\Q). 

(iv) $ 1 (P||Q)=if(P||Q). 

(v) * 2 (P\\Q) = tf(P\\Q). 

Thus we observe that $ 2 (P\\Q) = and $i(P||Q) = $ (Q\\P). 

For more studies on the measure (|1.5|) refer to Liese and Vajda ^H]; Vajda [27], Taneja [T§] . 
HO], jUj and Cerone et al. @]. 

Recently Taneja |23| and Taneja and Kumar [23] studied the ()1.5|) and obtained bounds in 
terms of the measures (|l.l|) - (|1.4jl . Here we shall extend the our study for the other measures 
known in the literature as triangular discrimination, harmonic mean divergence and symmetric 
chi-square divergence. 



The triangular discrimination is given by 

n 

(1.6) A(P\\Q)=J2 



(Pi 



i=l 



Pi + Qi 



After simplification, we can write 



(1.7) 
where 

(1.8) 



A(P\\Q) =2[1 -W(P\\Q)\ 



W(P\\Q) = J2 



'Pi + qi 



is the well known harmonic mean divergence. 



We observe that the measures (|1.3j) and (|1.4|) are not symmetric with respect to probability 
distributions. The symmetric version of the measure (|1.4|) famous as Jeffreys-Kullback-Leiber 
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J -divergence is given by 

(1.9) J(P\\Q)=K(P\\Q)+K(Q\\P). 
Let us consider the symmetric chi-square divergence given by 

(1.10) *(p\\Q) = x 2 (P\\Q)+x 2 (Q\\P) = E {Pl ~ qi?{Pl + qi) - 

Dragomir |12| studied the measure (|1.1U|) and obtained interesting result relating it to trian- 
gular discrimination and J -divergence. 

Some studies on the measures (jl.6[) and (|1.8|) can be seen in Dragomir [TJ3, an d Tops0e 
|26| . Recently, Taneja |23j an d Taneja and Kumar studied the measure (|1.5|) and obtained 
bounds in terms of the measures p.l|) - Q1.4[) . Similar kind of bounds on the measure Q1.9|) are 
recently obtained by Taneja |24| . In this paper, we shall extend the our study for triangular dis- 
crimination and symmetric chi-square divergence. In order to obtain bounds on these measures 
we make use of Csiszar's 5 a f-divergence. 

2. Csiszar's /-Divergence and Its Particular Cases 

Given a convex function / : [0, oo) — > E, the /—divergence measure introduced by Csiszar 
is given by 

(2-1) C f (P\\Q)=J2lif(f), 

i=i 

where P, Q G T n . 

It is well known in the literature that if f is convex and normalized, i.e., f(l) = 0, then 
the Csiszdr's function Cf(P\\Q) is nonnegative and convex in the pair of probability distribution 
(P,Q)£T n xT n . 

Here below we shall give the measures Q1.6|l and (|1,1U[) being examples of the measure ()2.1[) , 

Example 2.1. (Triangular discrimination). Let us consider 

(2.2) / A ( S ) = lEl-l)!, xG(0,oo) 

x + 1 

in ()2.1|) . we have 

{Pi-Qi) 2 



C f (P\\Q) = A(P\\Q)=Y J 



i=i ft + * 



where A(P||Q) is as given by (|1.6f) . 
Moreover, 

(x-l)(x + 3) 



(2-3) / A (x) = 

and 

(2-4) ft(x) 



+ 1) 3 ' 



Thus we have / A (x) > for all x > 0, and hence, /a (x) is strictly convex for all x > 0. Also, 
we have /a(1) = 0. In view of this we can say that the triangular discrimination is nonnegative 
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and convex in the pair of probability distributions (P, Q) € T n x T„. 

Example 2.2. (Symmetric chi-square divergence). Let us consider 
(2.5) h(x)= ( x ~ 1 )y + 1 ) j x€(0 ,oo) 

in (|2.1|h we have 

C f (P\\Q) = *(P||Q) = E - " ft)2(K + * } 



where * (P\\Q) is as given by (fTTTU)) . 

Moreover, 

(s - l)(2x 2 + x + 1) 



;r 2 



(2.6) 
and 

(2-7) /£(*) = 



Thus we have fq,(x) > for all x > 0, and hence, f\&(x) is strictly convex for all x > 0. 
Also, we have = 0. In view of this we can say that the symmetric chi-square divergence 

is nonnegative and convex in the pair of probability distributions (P,Q) G T n x T n . 

3. Csiszar's /—Divergence and Relative Information of Type s 

During past years Dragomir done a lot of work giving bounds on Csiszar's f— divergence. Here 
below we shall summarize the some his results jH], 0) 0- 

Theorem 3.1. Let f : M + — > [0, do) &e differentiable convex and normalized i.e., /(I) = 0. // 
P, Q G r„, i/ien we /iaue 

(3-1) O^C/CPIIQX^CPHQ), 
where pc f (P\\Q) is given by 

(3.2) W/PHQ) = C> ||P) - C f (P||Q) = J2 (Pi ~ *)/'(|)- 

If P,Q £ T n are such that 

0<r^ — ^ J R<oo, Vi € {1,2, ...,«}, 

/or some r and i? wii/t 0<r^l^i?< oo, i/ien we have the following inequalities: 

(3.3) 0^C f (P\\Q)^a Cf (r,R), 

(3.4) 0<C / (P||Q)<A7 / (r,fl) 
and 

(3.5) 0^Pc f (r,R)-C f (P\\Q) 

^ 1Cf (r,R) [(R-l)(l-r)- X 2 (P\\Q)] ^a Cf (r,R), 
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where 
(3.6) 

(3.7) 

and 

(3.8) 



a Cf (r,R) = -{R-rf j Cf (r,R), 



7C f (r, P) 



f'(R)-f'(r) 
R-r 



The following proposition is due to Taneja [23] an d Taneja and Kumar |25| and is a conse- 
quence of the above theorem. 

Proposition 3.1. Let P,Q €T n and s£l, then we have 

(3.9) 0<$ s (P||QHp*,(P||Q), 
where 

(3.10) p*.(p\\Q) = c*. (^H p ) - c t>'s ( p WQ) 

n / \ s— 1 

(« - 1)" 1 £ (»- *) (g) , 
i=i ^ ' 

Efe-ft)ln(|), a = l' 

k i=l 

J/ i/iere exists r, R (0 < r ^ 1 ^ R < oo) such that 

0<r^ — sCP<oo, Vi G {1, 2, . ..,«}, 
i/ien we /iaue t/ie following inequalities 



(3.11) 



0^<1> S (P||Q) <a$ s (r,P), 



(3.12) 

and 

(3.13) 

where 
(3.14) 

(3.15) 



0<$ fl (P||Q) 

0</3*.(r,22)-*,(P||Q) 
<7*.M) [(i?-l)(l-r)- X 2 (P||Q)] ^a $s (r,P), 



a*>,P) = -(P-r) 2 7 <i> s (r,P), 



/Mr, P) 



( (R~l)(r s -l) + (l-r)(R s -l) 
(R-r)s(s-l) - 
(fl-l)lnl+(l-r) In £ 

(R-r) ' 
(fl-l)rlnr+(l-r)fllnfl 



8^0,1 

s = 

s = 1 



and 
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We can also write 7$ s (r, R) as follows 



(3.17) 



7*. (r, R) 



L s ~t(r,R), 8^1 
Lz\(r,R) a = l' 



where L p (a, b) is the famous (Bullen, Mitrinovic and Vasic 3 ) p-logarithmic power mean given 
by 



(3.18) 



L p (a,b) = < 



6P+l_ a p+l 



(p+l)(6-a) 
6— a 



In b— In a ' 

l 

b — a 



, p^-i,o 

p = — 1 
p = 



for all p € TSL, a ± b. 

The expression (j3.1U|) admits the following particular cases: 

(i) p^APWQ) = 3MQ\\P) - |x 2 (QII^)- 

(ii) p^(P\\Q) = x 2 (Q\\P). 
(hi) P9l (P\\Q) = J(P\\Q). 

n 

(iv) p* 1/a (P\\Q) = 2Z(qi-Pi)< 

i=l 

(v) p^(p\\Q) = x 2 (p\\Q) 



The expression ([3.15ft admits the following particular cases: 

(ii)^ (^)= (fi - i)in fc ( r )in i 



(iii) (3 01 (r,R) 



(R-l)r In r+(l-r)R In g 
R-r 



(v) fl i2 (P\\Q)= ("-')"-■■) , 



The following theorem is due to Taneja |23| and Taneja and Kumar |25| . 

Theorem 3.2. Zei / : I C R+ — > [0, oo) i/ie generating mapping is normalized, i.e., /(I) 
anc? satisfy the assumptions: 

(i) f is twice differentiate on (r, R), where O^r^l^R^oo; 

(ii) there exists real constants m,M such that m < M and 

(3.19) m < x 2 ~ s f"{x) < M, Vx e (r, i?), s£l. 

If P,Q € T n are discrete probability distributions satisfying the assumption 

0<r^ — ^R<oo, 
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then we have the inequalities: 

(3.20) m$ s (P\\Q) ^ C f (P\\Q) ^ M$„(P\\Q), 

(3.21) m[p* a (P\\Q)-$ 8 (P\\Q)] 

^p Cf (P\\Q)-C f (P\\Q) 
^M[p* a (P\\Q)-<f> s (P\\Q)} 

and 

(3.22) m\fa t (r,R)-$ a (P\\Q)] 

<Pc f (r,R)-C f (P\\Q) 

^M\fa.(r,R)-$ B (P\\Q)], 

where C f (P\\Q), $ S (P\\Q), pc f (P\\Q),p*,(P\\Q), Pc f {r,R) and 0<s> s (r, R) are as given by fT®, 
1731) . ITS) . rnW . [Sljjj and PTWD respectively. 

The above theorem unifies some of the results studied by Dragomir [Sj, ^U], [TT] . 

In the papers Taneja |23| and Taneja and Kumar [25] considered the particular values of s 
and <E> S by taking s = —1, s = 0, s = 5, s = 1 and s = 2. The aim here is to obtain results 
by taking different values of / given by examples 2.1-2.2, and then obtain particular cases for 
different values of s. 

Remark 3.1. If is it not specified, from now onwards, it is understood that, if there are r,R then 
0<r^| i ^i2< 00, Vi G {1, 2, n}, with 0<r^l^i?<oo where P = (pi,P2, ■■■■,Pn) G Tn 
and P = (qi,q 2 ,....,q n ) G T n . 

4. Triangular Discrimination and Inequalities 

In this section, we shall give bounds on triangular discrimination based on the Theorems 13. II 
andl3~2l 

Theorem 4.1. For all P,Q G T n , we have the following inequalities 
(4.1) 0^A(P\\Q)^ PA (P\\Q), 
where 

n f — \ 2 

(4-2) pA (p||Q) = ^(£L^L) fe + 3g 4 ). 

If there exists r,R(0<r^l^R< 00) suc/i i/iai 

0<r^ — <#<oo, Vz G {1, 2, n}, 
ft 

i/ien we /iaue i/ie following inequalities: 

(4.3) ^ A(P||Q) <a A (r,i2), 



(4.4) 0^ A(P||Q) ^0 A {r,R) 
and 

(4.5) 0^/? A (r,i?)-A(P||Q) 

^7A(r,i?) [(fl-l)(l-r)-x 2 (i'||0)] <a A (r,fl), 



s 
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where 

(4.6) a A (r, R) = -(R - r 



(P-l)(P + 3) (l-r)(r + 3) 



(4.7) p A (r,R) 



(R + l) 2 (r + 1) 

2(R- l)(l-r) 



(P + l)(l + r) 
and 



(4.8) 7A(r,fl) = (i2-f 



-l 



(P-l)(P + 3) + (l-r)(r + 3) 



(i? + l)2 (r + l) 2 

Proof. Follows from the Theorem 13. II by considering / by f A and making necessary calculations. 

□ 

Theorem 4.2. Let P, Q E T n and s£l. Let there exists r,R(0<r^l^R< oo) such that 
0<r^2i^ J R<oo ; ViG {l,2,...,n}. 

(a) For s ^ — 1, we /lave the following inequalities: 

Q r 2~s od2-s 

(4-9) ___<J> S (P||Q) < A (p||Q) ^ ___^(F||Q), 

(4-10) ^l^(p||Q)_$,(p||0)] 

< A*(P||Q) < \p*.{P\\Q) - *s(P\\Q)] 

and 

(4.H) l¥^\P*.(r,R)-*B(P\\Q)] 

(r + l) d 

09 A (r,i2)-A(P||Q) 

8P 2 " S 
(P + 1) 

(6) For s ^ 2, we /iai>e £/ie following inequalities: 

op2-s 0^,2— s 

(4.i2) (pTTF^ (p||g) ^ A(p||g) ^ VTW* s{Pim 

(4-13) _|^_!_[ /3$a (P||Q)_$ s (P||Q)] 



< TT> I ^ 3 [^ S (r,fi)-^(F||Q)]. 



< A*(P||Q) < [ P$S (F||Q) - *.(P||Q)] 



and 



(4-14) , D | lV2 \P*,(r,R) ~ *,(P\\Q)] 



P 1 "' 
(R+ 1 ) 

</? A (r,i2)- A(P||Q) 

l-s 



^ 7^1)2 [/M^-^IIQ)], 
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Pi + 



where 

n 

(4.15) A*(P||Q) = PA (P\\Q) - A(P\\Q) = 2j> 

i=i 

Proof. Let us consider 

8x 2 ~ s 

(4.16) gA(x) = x 2 - a f'i(x)= xG(0,oo), 

[x + I) 6 

where f'^(x) is as given by (|2.4|) . 
We have 



(4.17) 



, 8x 1 - s [(s + l)x + (s-2)] j^O, 

9a\ x ) — 



(* + l) 4 

In view of (|4.17j) . we conclude the followings: 



< 0, s > 2 



8r z 



(4.18) 
and 
(4.19) 



m = inf g(x) = min g(x) 
x£[r,R] xe[r,R] 



(R+l) 
8R 2 



S < -1 
-. s^2 



M = sup = max g(x) = I &t-l 



(r+l) 



-. a<-l 
T. O 2 



xe[r,_R] xe[r,R] 
From (j4.18j) and (|4.19j) and Theorem 13.21 we have the required proof. 
The following propositions are the particular cases of the above theorem. 



Proposition 4.1. We have the following bounds in terms of \ 2 ~ divergence: 
(4.20) 



4r 3 4 7? 3 

' : X \Q\\P) < A(P||Q) < —-—^(Q\\P), 



(r + l) 3 ' 



(P+l) 3 ' 



(4.21) 

and 
(4.22) 



8r d 



{r + y5 [3$3(Q||P)-X 2 (QI|P)] 

< A*(P||Q) < [3$ 3 (Q||P) - X 2 (Q||P)] 



(r + l) 3 



(P-l)(l-r) ^ 2 



rR 

2(R- 1)(1 -r) 
(P + l)(l+r) 



X'(Q||P) 
-A(P||Q) 



4P 3 



(P-l)(l-r) 
rP 



x 2 (QI|P) 



(P + i) 3 

Proo/. Take s = -1 in (|4~9|) . (j4~PU|) and (gHH) we get respectively (|4~2n|) . (|4~2"Tj) and 

Proposition 4.2. VFe Ziaue the following bounds in terms of x 2 — divergence: 



(4.23) 



4 ,2 /Dll ^/A/ D „n^ 4 ..2 



(P+l) 



r ^(P||QK A(P||QK 



(r + l) 3 



x^HQ), 
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and 

(4-25) ^1^3 [(R - 1)(1 - r) - x 2 (P\\Q)} 

^ (J2+l)(l + r) 1 

<(^3[(^-i)(i--)-x 2 (P||Q)]- 

Proo/. Take s = 2 in (jH2J), <I3TT31) and (BTT^l we get respectively ijOSjl . (l4~24]l and (B35l . □ 

We observe that the Theorem 14.21 is not valid for s = 0, \ and 1. These particular values of 
s we shall do separately. In these cases, we don't have inequalities on both sides as in the case 
of Propositions 14.11 and 14.21 

Proposition 4.3. The following inequalities hold: 

32 

(4.26) 0<A(P\\Q)<-K(Q\\P), 

(4-27) < A*(P||Q) < - [x 2 (Q||P) - K(Q\\P)] 

and 

(4-28) 0^-K(Q\\P)-A(P\\Q) 

32(P-l)lni + (l-r)lni 2(R - 1)(1 - r) 

5>- 



27 R-r (P+l)(l + r) 

Proof. For s = in ()4.16j) . we have 

8x 2 

(4.29) g A (x) = ¥TW . 

This gives 

8x(x -2) /> 0, x ^ 2 



(4.30) </ A (x) 



(x + 1) 4 |<0, x^2 



Thus we conclude that the function gw{x) given by ([4.29ft is increasing in x £ (0,2) and 
decreasing in x E (2,oo), and hence 

32 

(4.31) M= sup # A (x) = max g A (x) = g A (2) = —. 

a;e(0,oo) xe(0,oo) 11 

Now (IPH together with (l3~2Ul) . (I3~2T1) and (l3~22l give respectively (jOHjl . (l4~2T|) and CT . 

□ 

Proposition 4.4. T/ie following inequalities hold: 

(4.32) 0< A(P||Q) <4 /i(P||Q), 
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(4.33) 0^A*(P||QK2 yV<7i-pi) A p-4 h(P\\Q) 
and 

(4.34) ^ 4 h(P\\Q) - A(P\\Q) 

< 4(\/l-l)(l- V?) 2(P-l)(l-r) 
/R + ^ (fl+lXl + r)' 

Proof. For s = A in (|4.16|) . we have 

8 x 3/2 

(4.35) 5A (x) = (x + 1)3 . 
This gives 

_ , 12y^(x-l) J>0, S<1 

(436) 5a(x) = " \<0, x>T 

Thus we conclude that the function g A {x) given by 1)4.35)) is increasing in x G (0,1) and 
decreasing in x G (1, oo), and hence 

(4.37) M = sup g A {x) = max g A {x) = <7a(1) = 1- 

xG(0,oo) xe(0,oo) 

Now (IQ71) together with (l3~2n)l . (l3~2"TT) and (l3~22l) give respectively (IQ2j) . fQgj) and (ITOl) . 

□ 

Proposition 4.5. We /ioue following inequalities: 

(4.38) 0<A(P||Q)<||^(P||Q), 

32 

(4.39) 0^A*(P\\Q)^-K(Q\\P) 
and 

32 

(4.40) 0^^K(P\\Q)-A(P\\Q) 

32 (P- l)rlnr+(l-r)PlnP 2(P- l)(l-r) 



27 P-r (P+l)(l+r) 

Proof. For s = 1 in ()4.16j) . we have 

(4.41) g A (x) 



This gives 
(4-42) g' w (x) 



[x + lf 
8(2x - 1) _ J> 0, x ^ ± 

+ 1) 4 K o, x > i ' 



Thus we conclude that the function g A (x) given by ()4.41)1 is increasing in x G (0, ^) and 
decreasing in x G (i, oo), and hence 

1 32 

(4.43) M= sup g A (x) = max g A (x) = g(~) = —. 

xG(0,oo) a;e(0,oo) Z At 
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Now flOg)) together with (l3~2771) . (I3~2T1) and (l3~22l give respectively CT . JOty and 

□ 

Remark 4.1. In wieu> of relation ji.7[ j and Propositions \4-1^4^\ we have the following main 
bounds on harmonic mean divergence: 

M4) (7TIF x2(QI|jP) ^ 1 " w{m) ^ WTW x2{Qlin 

(4-45) —l—^^Hg) < 1 - W (P||Q) < j^x 2 (P\\Q), 

(4-46) 0<l-W(P||Q)<^if(Q||P), 

(4.47) < 1 - W(P\ \Q) s£ 2 fc(P| \Q) 

and 

(4-48) 0<l-W(P||Q)<P^(P||g). 

The inequalities Q4.45JI were also studied by Dragomir 8 . The inequalities (|4.48j) can be seen 
in Dragomir 10 . The inequalities ()4.32[) can be seen been in Dragomir and Tops^e |26| . 
The inequalities ()4.38[) can be in and Dragomir |1U| . 

5. Symmetric Chi-square Divergence and Inequalities 

In this section, we shall give bounds on symmetric chi-square divergence based on the Theo- 
rems 13.11 and 13.21 

Theorem 5.1. For all P,Q £ T n , we have the following inequalities: 
(5.1) 0<*(P||Q) <MP\\Q), 

where 

(pi-qi) 2 (p 2 i +q 2 i) 



(5.2) p*(P\\Q)=y(P\\Q) + J2 



i= i 

If there exists r, P(0<r^l^P<oo) such that 

0<r^ — sCP<oo, Vi€ {1,2, ...,«}, 
Qi 

then we have the following inequalities: 

(5.3) s£ *(P||Q) < ay(r,R), 



(5.4) 

and 

(5.5) 



0<*(P||Q) ^fc(r,R) 

0^fc(r,R)-V(P\\Q) 
< 7 *M [(R-l)(l- r )- X 2 (P\\Q)] < a*(r,fl), 
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where 

(5.6) a*(r,R) = \{R-rf [2L^(r,R) - L^(r,R)] , 

(5.7) fc{r,R) = {R-l){l-r){R + r) 
and 

(5.8) ^(r,R) = 2L^(r,R)-L^(r,R). 

Proof. Follows from Theorem by considering / by fm and making necessary calculations. □ 

Theorem 5.2. Let P, Q G F n and s£l. Let there exists r, P(O^r^l^P^oo) such that 
0<r^|i^ J R<oo, {1,2,...,™}. 

(a) For s ^ — 1, we /lave i/ie following inequalities: 

(5-9) ^/W llQ) £ *(P||Q) £ ^^/W llQ), 

(5-10) 2(r r 3 i+/ } [^(PHQ)-^(PHQ)] 

< **(p\\Q) < 2{ %t 1] Ip*s(p\\Q) - MP\\Q)} 



and 



(5.H) \fa.(r,R)-*.iP\\Q)] 

</3»(r,J2)-*(P||Q) 

^ 2( ^ 3 i+s 1} D9».(r,JZ)-^(P||g)]. 
(6) For s ^ 2, we have the following inequalities: 
(5-12) gCg+l) g j(P || Q) ^ ^ (P || Q) ^ 2(r r 3 1 + 1) ^(P||Q), 

(5-13) K(P||Q)-$ S (P||Q)] 

< «*(p||g) < [p*.(p||Q) - *.(P||g)] 

and 

(5-14) 2( ^i+ a 1} [^ s (r,P)-^(P||Q)] 

</3*(r,li)-tf(P||Q) 

< 2(r r 3 i+ a 1} \fa.(r,R)-9.(P\\Q)h 

where 

(5.15) **(P||Q) = p*(P\\Q) - *(P||Q) = £ fo-^fri+g?) . 
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Proof. Let us consider 

(5.16) g*(x) = x 2 - s f£(x) = 2x- 1 ~ s (x i + 1), x £ (0, oo) 

where f^,(x) is as given by (|2.7|) . 
We have 



(5.17) ^(x) = -2x~ 2 - s [(s - 2)x 3 + (a + r 
From (|5.17|l . we conclude the followings: 

(5.18) m 
and 
(5.19) 



^ 0, s ^ -1 
< 0, s > 2 



inf g\sr(x) = min g$(ic) 

te[r,R] xe[r,_R] 



2(r 3 +l) 



2(R 3 +1) 
R i+s ■ 



S < -1 

s > 2 



M = sup g^{x) = max g^{x) 
xe[r,R] xe[r,R] 



— RTTi - I S ^ — 1 

2(r 3 +l) > 9 



In view of Q5.18JI and (|5. 19f) and Theorem 13.21 we have the required proof. 
Proposition 5.1. We have the following bounds in terms of x 2 ~ divergence: 

(r 3 + i) x 2 (Q\\P) ^ *(P\\Q) < (R 3 + l)x 2 (Q\\P), 



(5.20) 
(5.21) 

and 
(5.22) 



2(r 3 + l) [3$ 3 (Q\\P)-X 2 (Q\\P)] 

< **(P\\Q) < 2(i? 3 + 1) [3, $ 3 (P||Q) - x 2 (QII^)] 



(r 3 + 1) 



(fl_l)(l_r) 



x 2 (QI|P) 



< (fl-l)(l-r)(JJ + r)-*(P||Q) 



^ (R 3 + 1) 



(fl-l)(l-r) 
rR 



x 2 {Q\\P) 



□ 



Proo/. Take s = -1 in (pT3Jl . (gJUD and (t5~TTl) we get respectively (IB371) . (t5~2Tl) and (t5~22l . □ 

Proposition 5.2. The following bounds on in terms of x 2 ~ divergence hold: 

(5.23) 



(5.24) 

and 

(5.25) 



i? 3 



^tl X 2 ( p|| Q) ^ *. ( p||Q) ^ !i±l x 2 (p||Q) 

-^[{R-l){l-r)- X \P\\Q)] 
^fa{r,R)-^{P\\Q) 
r 3 + 1 



[(R-l)(l-r)- X 2 (P 



Proof. Take s = 2 in (t5~T2l . (t5~T3l and (EHl) we get respectively (pT23Jl . (l5~2lj) and (JSJ. □ 
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We observe that the above two propositions follows from Theorem 15,21 immediately by taking 
s = — 1 and s = 2 respectively. But still there are another values of s such as s = 0, s = 1 and 
s = 2 f° r which we can obtain bounds. These values are studied below. 

Proposition 5.3. We have following bounds in terms of relative information: 

(5.26) 0^3^/2 K(Q\\P) ^V(P\\Q), 

(5.27) 0^3^2[ X 2 (Q\\P)-K(Q\\P)} < W*(P||Q) 
and 

(5.28) 0^V(P\\Q) -3$2 K(Q\\P) 

<(*-!)(!- r)(* + r) - s^^MilhlM. 

it — r 

Proof. For s = in (|5.16[) . we have 

/ x 2(x 3 + l) 

(5.29) S*x = - '-, 

x 

This gives 

2(2x 3 - 1) 



(5.30) g'y{x) 



x 2 



_ 2(^2x-l)(y / 4x 2 + ^2x + l) f>0, 

Thus we conclude that the function g^(x) given by Q5.29JI is decreasing in x G (0, -^=) and 
increasing in x G (-^i 00 ) 5 and hence 

(5.31) m = inf g^(x) = min g^(x) = 5*(— =) = 3v^2. 

xe(0,oo) o;e(0,oo) v2 

Now (t53B together with (l3~2T71) . (I3~2H and (l3~22l give respectively (15^61 . g!ZZ> and jOty . 

□ 

Proposition 5.4. We /iaue following bounds in terms of Hellinger's discrimination: 

(5.32) 0<16/i(P||g)<*(P||Q), 



(5.33) < 16 



^ i=1 V Pi 



< **(P||Q) 



and 

(5.34) < *(P||Q) - 16 h(P\\Q) 



16 



INDER JEET TANEJA 



Proof. For s = \ in 1)5.16)) . we have 

2(x 3 + 1) 



(5.35) gy(x) 



x 3/2 ■ 

This gives 

3(x 3 -l) 3(x - l)(x 2 + x + 1) 0, x^l 



(5.36) g'y(x) 



x 



5 / 2 X 5 / 2 1^0, X ^ 1 



Thus we conclude that the function gy(x) given by ()5.35)) is decreasing in x G (0,1) and 
increasing in x G (l,oo), and hence 

(5.37) m = inf g-$(x) = min g^(x) = gq,(l) = 4. 

xS(0,oo) x£(0,oo) 

Now (15371) together with (l3~2"U)) . (l3~2Tl) and (l3~22l give respectively (l5~3~2l . (OH)) and (Oi)l . 

□ 

Proposition 5.5. VFe Ziaue the following bounds in terms of relative information: 

(5.38) 0^3^ #(P||Q) <#(P||Q), 



(5.39) ^ 3\/2 K(Q||P) ^ V*(P\\Q) 
and 

(5.40) 0^^(P||Q)-3v / 2^(P||Q) 

< (* - 1)(1 - r)(* + r) - 3^2 (*- l)rlnr + (1 -r)fllnfl 

R — r 

Proof. For s = 1 in ()5.16j) . we have 

/ x 2(x 3 + l) 

(5.41) gv{x) = K 2 j . 

x z 



This gives 

2(x 3 - 2) 



(5.42) «&(x) 



;r 3 



2(x - y^Xx 2 + yg x + y 7 !) 0, x^f/2 
x 3 1<0, x^v/2 



Thus we conclude that the function g^(x) given by ()5.41)) is decreasing in x G (0, v^2) and 
increasing in x G (v2, oo), and hence 

(5.43) m = inf g^(x) = min g^(x) = gqr(\^2) = 3\^2- 

ice(o,oo) xe(o,oo) 

Now (l5~i3l together with (l3~2l71) . (I3~2H and (l3~22l give respectively CT . (I5~3H)) and (l5~iT71) . 

□ 
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